This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 

As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 



60 



1/15 




CPU 
1 


j20 


RAM 
i 


y30 

40x 





70 



Fig. 1 



/ 



50 



110 



130 



31 



100 



Image 
Processing 



120 



200 



Face 
Detector 



140 
X_ 



(XX) 



230 



Lens 
Control 
2= 



User 
Controls 



Speech 
Detector 



240 



190 



Ho" 




GSM 



Audio 
Processing 



150 



y 



21 



-170 



220 
From Microphone(s) 



Fig. 2 



2/15 



300-^ 


Set of Face 
(and Non-face) 
Training Images 




Training Process 




► 












330-^ 


Synthetic Variations 




Histogram Data 



-310 



320 



Fig. 3 



320 



Histogram Data 



350 



Image or Video Data 



340 



Face Detection 



* Face / Non-face 



Fig. 4 



3/15 



CD 

1 1 

±Z *co 
co o 

CD <D 

co _c 

•; — : * 

CD ro 
=3 CO 

°* 5 
CO o 
CD O 

E o 

CD 

of 

O > 



Histogram for a given block 
position within 64x64 window 




Quantised attribute value 



Fig. 5 























— j..... 




































--— j— -j — 














•—<-—* — 














— ■ j — "j — 












































Large training set 
of 64x64 windows 




Set of eigenblocks 



Very large set 
of 16x1 6 blocks 



Fig. 6 



• » 



4/15 




Fig. 7 




Fig. 8 




Frequency of occurence of 
bin number at biock position (i,j) 




430 



Bin number (representing 
combined quantised attributes) 

HISTOGRAM 



Fig. 9 



6/15 









}..... 




— - < — i — t — - 

..4-4--U" 




>.••<(—■ 


— * — — *■ 




: 


: : i 



64x64 window 
from test image 




Set of blocks 
extracted from all 
chosen positions 
in window 



490 500 510 

]kj\^ -^p(hj)-^iog[p(iJ)] 



^P(U)^log[p(ij)] 



•p(ij)^log[p(i,j)]> 



A 



•^POJ) *log[p(i,j)]- 



Bin number for 
block at position (i j) 

Fig. 11 




460 



470 



480 

Histogram bin 
number 



64x64 window / Set of Eigenblocks Eigenbtock Quantised 
45q7 weights weights 



Fig. 12 



7/15 




oooooooo 
oooooooo 
cd lo cd to cd un cd lo 



S90U9jnooo jo JsqiunN 




o 

CVJ 



CD 



CD CD CD CD CD CD CD CD CD CD CD 
CDCDCDCDCDCDCDCDCDCD 
o in O If) CD LO CD LO CD UD 
mTfTtcOCOCMCNT-x- 

s90U8jnooo jo J9qwnf\| 



CD CD CD CD CD CD 

CD CD CD CD CD CD 

CD CO CD LO CD LO 

in ^- ^- co co cm 



CD CD 

CD CD 

CD LO 

CM t— 



sgougjnooo jo J9qiun|s| 



8/15 



CO 



5 <D 

CNJ j- 

1^ 0 CM 



^ gj LL 

CO 
CO 



CO CO CO CO CO CO co 

oo r-— co lo ^ co cvi 

saouejnooo jo jeqwnN 




T3 
CM 



2 o c o) 



J 1-- ■ 1 1 


11,1 

1 

I 




♦ 

1 

r 




# 

< 

] 




> 

✓ 


1 1 1 1. 


> 

1 1 1 *N 



LO 
CO 
LO 

s: 

to 

!£2 CD 
co 

oo <= 

£8 .£ 



CD 



CO CO CO CO CO CO CO 
CO CO CO CO CO CO CO 

co r — co lo co cnj 

S9ou9jnooo jo J9qiunN 



CO CO CO CO CO 
CO CO CO CO CO 

oo r — co lo "^f - 



CSl 

CO 
LO 

CD 



CO CNJ 

seouamooojo J9qiunN 



9/15 




Fig. 13a Fig. 13b Fig. 13c 




Fig. 13f I 

Fig. 13g 



10/15 



542 



User Metadata 



544 



Camera Settings 



560 v 



Prediction 



Kalman Filter 



Update 



Video Data 



\J 



540 



545 



Face Detection 



550 



Skin Colour 
Matching 



T 



Comparison of 
Eye Positions 



Comparison of 
Eye Positions 



570 



Decision on which 
Eye Positions to 
Accept 



S 



580 



Shot Boundaries 



565 



Fig. 14 



11/15 



620 630 




Fig. 15a 



640 

j 




Fig. 15b 




Fig. 16 




Fig. 18 



13/15 



800 



Picture Stamp A 



840 




Picture Stamp B 
860 / 



El 



El 



El 



810 



El 



El 



El 



El 



El 



El 



El 

us 



El 



El 



Fig. 19a 



Face A 



820 830 

Fig. 19b 



J I I L. 



Face B 



Fig. 19c 



850 



910' 




912 



914 



910" 



-916 



-914 



Fig. 21a 



Fig. 21b 



14/15 




Fig. 20 



15/15 



1000 




